Tony Virelli - Web Developer - HTML, xHTML, PHP, MySQL, JavaScript» John Hass

Asterisk cdr_adaptive_odbc Trouble

John Hass — Tue, 31 Jan 2012 14:56:54 +0000

So I have been fighting for two days straight on an issue in Asterisk with cdr_adaptive_odbc saying:
cdr_adaptive_odbc.c:686 odbc_log: Column type -9 (field ‘wavve:cdr:clid’) is unsupported at this time.

It would repeat this message for all my varchar columns, and of course wouldn’t insert any data, I googled every combination of everything I could think of and the closest I came to was this: https://issues.asterisk.org/jira/browse/ASTERISK-18278 Now I don’t want to talk bad about the Asterisk/Digium guys but from my experience the guys working on the ODBC part of Asterisk can kind of be short with the users. Take this blob of text for example:

; On Wednesday 10 September 2008 21:11:16 Tilghman Lesher wrote:
;
; I thought that the sample cdr_adaptive_odbc.conf was rather clear, but
; apparently not.

I mean come on guys what value does this sentence bring to anything.

Anyways here is how I fixed it.

show table status

I noticed that the Collation was utf8_general_ci I had a feeling that this was wrong so I ran:

alter table cdr CONVERT TO CHARACTER SET latin1;

and bingo, after a module reload I was storing all the cdr data in MySQL

I Hope this saves people some time.

Keep on trucking and have fun!

Make 007 Jealous With RSA Encryption

John Hass — Mon, 15 Mar 2010 22:50:17 +0000

Make 007 Jealous

Public/Private encryption is not a new thing, did you know you can use my favorite swiss army knife to send secret messages to your friends…. Scratch that, I don’t have any friends… Perl Makes this easy with a little module calls Crypt::RSA, yes RSA is under fire for security blah blah, I don’t care, it’s still secure, because Mr. S’s (yes it’s a dudes name) I can’t pronounce nor spell, I know it will be fairly decent, I am almost about sure Mr. S should be Dr. S, but that just sounds evil, so without further ado, public/private key encryption with perl.

Two people in this Article Tony and John, John wants all correspondence encrypted Tony Encrypts.

I am on my new Mac now, so your mileage may very….

sudo perl -MCPAN -e shell
install Crypt::RSA

it asks you about a ton of dependencies, don’t do what your high school guidance counselor told you and just say yes.

Create something to make the keys

#!/usr/bin/perl
use Crypt::RSA;
$rsa = new Crypt::RSA;
if ($ARGV[0] eq "--makekeys") {
	($public, $private) = $rsa->keygen( 
				Size => 2048,
				Filename => "keylock",
				);
	exit;
}

The start of out program generate our rsa key, keylock.private (and keep this private, no touchy no sendy) and keylock.private, send this to everyone

ok send the public key to tony, so he can send us a message…. Tony should create the message now

if ($ARGV[0] eq "--createmessage") {
	$key = $ARGV[1];
	$message = $ARGV[2];
 
	#open the key
	$akey = new Crypt::RSA::Key::Public (	Filename => "$key");
	my $output = $rsa->encrypt(Message => $message,Key=> $akey)|| die $rsa->errstr();
	open ENC, ">message" or die $!;
	binmode ENC;
	print ENC $output;
	exit;
}

One thing that was a gotcha for me was writing the file, I forgot to tell perl to write it binary, since the encryption is all binary, we must write it so. We now have a file called “message” if you try to edit the file, it’s all gobble gook. Tony can now send you this message, and only you can read it, but how?

if ($ARGV[0] eq "--readmessage") {
	$key = $ARGV[1];
	$message = $ARGV[2];
 
	open FILE, "$message" or die $!; 
	binmode FILE;
	my ($buf, $data, $n);
	while (($n = read FILE, $data, 4) != 0) {
		$buf .= $data;
	} 
	close(FILE); 
	$akey = new Crypt::RSA::Key::Private->read(Filename => "$key");
	my $output = $rsa->decrypt(Cyphertext => "$buf",Key => $akey)|| die $rsa->errstr();
	print $output ."\n";
 
	exit;
}

So now we read the file “message” in using our private key, since Tony encrypted the message with our public key, we can now read it with the private key…. So how does this work?

John-Hasss-Mac-Pro:~ john$ ./keylock.pl --makekeys
John-Hasss-Mac-Pro:~ john$ ./keylock.pl --createmessage keylock.public "007 would be so jealous"
John-Hasss-Mac-Pro:~ john$ cat message 
?????u?????מ?n???-@?l?Q??)??~}3?"h2??=,??3??݁/m?s?[?M)?F?}?|ߩJ????k;?7??i???D?\w;?U??ʬ??y7ǳ??&?]pXv?-???E@"X?E?HH0?(S?"?`?,?R??7???ϳ
  ??Ցh???촇??K??Rs??uxs;??r^΀?G?????5??W??Y???4Y??_~?(YͷӍr\űeĥr??John-Hasss-Mac-Pro:~ john$ 
John-Hasss-Mac-Pro:~ john$ 
John-Hasss-Mac-Pro:~ john$ ./keylock.pl --readmessage keylock.private message
007 would be so jealous
John-Hasss-Mac-Pro:~ john$

Welcome to the magic of public private key encryption!

Have fun!

keylock.zip (34)

Using NMAP To Detect Server Type

John Hass — Mon, 28 Dec 2009 14:33:55 +0000

When you talk power utilities on any *nix it’s hard to skip nmap. Ever since it’s introduction nmap has been used for good and evil. If you’ve ever had a server hacked chances are they used nmap or some sort of nmap code to get the job done. Just how easy is it to detect the server type from nmap? Try my windows 2003 server (I know kick me in the nuts and call me sally).

nmap -A -T4 192.168.10.1

it took over a minute to get the results, but here is what I got.

Starting Nmap 5.00 ( http://nmap.org ) at 2009-12-15 15:42 CST
Interesting ports on server1.local.example.com (192.168.10.1):
Not shown: 963 closed ports
PORT      STATE SERVICE       VERSION
21/tcp    open  ftp           Microsoft ftpd
25/tcp    open  smtp          Microsoft ESMTP 6.0.3790.3959
|  smtp-commands: EHLO example.com Hello [192.168.10.34], TURN, SIZE, ETRN, PIPELINING, DSN, ENHANCEDSTATUSCODES, 8bitmime, BINARYMIME, CHUNKING, VRFY, X-EXPS GSSAPI NTLM LOGIN, X-EXPS=LOGIN, AUTH GSSAPI NTLM LOGIN, AUTH=LOGIN, X-LINK2STATE, XEXCH50
|_ HELP This server supports the following commands: HELO EHLO STARTTLS RCPT DATA RSET MAIL QUIT HELP AUTH TURN ETRN BDAT VRFY
80/tcp    open  http          Microsoft IIS webserver 6.0
|_ html-title: Under Construction
110/tcp   open  pop3          MS Exchange 2003 pop3d 6.5.7638.1
|_ pop3-capabilities: USER EXPIRE(NEVER) UIDL PIPELINING TOP SASL(NTLM)
135/tcp   open  msrpc         Microsoft Windows RPC
139/tcp   open  netbios-ssn
143/tcp   open  imap          Microsoft Exchange Server 2003 imapd 6.5.7638.1
|_ imap-capabilities: LOGIN-REFERRALS IMAP4 AUTH=NTLM IMAP4rev1 MAILBOX-REFERRALS UIDPLUS LITERAL+ IDLE NAMESPACE CHILDREN
445/tcp   open  microsoft-ds  Microsoft Windows 2003 microsoft-ds
593/tcp   open  ncacn_http    Microsoft Windows RPC over HTTP 1.0
691/tcp   open  resvc         Microsoft Exchange routing server 6.5.7638.138.1
993/tcp   open  tcpwrapped
995/tcp   open  tcpwrapped
1037/tcp  open  msrpc         Microsoft Windows RPC
1073/tcp  open  msrpc         Microsoft Windows RPC
1074/tcp  open  msrpc         Microsoft Windows RPC
1076/tcp  open  msrpc         Microsoft Windows RPC
1088/tcp  open  msrpc         Microsoft Windows RPC
1089/tcp  open  msrpc         Microsoft Windows RPC
1137/tcp  open  msrpc         Microsoft Windows RPC
1801/tcp  open  unknown
2103/tcp  open  msrpc         Microsoft Windows RPC
2105/tcp  open  msrpc         Microsoft Windows RPC
2107/tcp  open  msrpc         Microsoft Windows RPC
3389/tcp  open  microsoft-rdp Microsoft Terminal Service
4343/tcp  open  ssl/http      Microsoft IIS webserver 6.0
|_ sslv2: server still supports SSLv2
|  http-auth: HTTP Service requires authentication
|    Auth type: Negotiate
|_   Auth type: NTLM
|_ html-title: You are not authorized to view this page
5900/tcp  open  vnc           VNC (protocol 3.8)
6001/tcp  open  ncacn_http    Microsoft Windows RPC over HTTP 1.0
6002/tcp  open  ncacn_http    Microsoft Windows RPC over HTTP 1.0
6004/tcp  open  ncacn_http    Microsoft Windows RPC over HTTP 1.0
8080/tcp  open  http          Microsoft IIS webserver 6.0
|  http-auth: HTTP Service requires authentication
|    Auth type: Negotiate
|_   Auth type: NTLM
|_ html-title: You are not authorized to view this page
8181/tcp  open  http          Apache Tomcat/Coyote JSP engine 1.1
|_ html-title: Site doesn't have a title (text/html).
8443/tcp  open  ssl/http      Apache Tomcat/Coyote JSP engine 1.1
|_ html-title: Site doesn't have a title (text/html).
9000/tcp  open  http          Veritas backup exec continuous protection httpd
|_ html-title: Site doesn't have a title (text/xml).
9001/tcp  open  http          Veritas backup exec continuous protection httpd
|_ html-title: Site doesn't have a title (text/plain).
9002/tcp  open  http          Veritas backup exec continuous protection httpd (unauthorized)
|_ html-title: Site doesn't have a title (text/html).
9003/tcp  open  http          Veritas backup exec continuous protection httpd (unauthorized)
|_ html-title: Site doesn't have a title (text/plain).
10000/tcp open  backupexec    Veritas Backup Exec 9.0
Service Info: OS: Windows
Host script results:
|  smb-os-discovery: Windows Server 2003 3790 Service Pack 2
|  LAN Manager: Windows Server 2003 5.2
|  Name: example\SERVER1
|_ System time: 2009-12-15 15:38:06 UTC-6
|_ nbstat: NetBIOS name: SERVER1, NetBIOS user: , NetBIOS MAC: 00:11:43:e3:d5:f2
Service detection performed. Please report any incorrect results at http://nmap.org/submit/ .
Nmap done: 1 IP address (1 host up) scanned in 68.23 seconds

Surely this can’t work in Windows Server 2008?

Starting Nmap 5.00 ( http://nmap.org ) at 2009-12-15 15:47 CST
Interesting ports on server.local.example.com (192.168.10.5):
Not shown: 970 closed ports
PORT     STATE SERVICE       VERSION
25/tcp   open  smtp          Microsoft ESMTP
|  smtp-commands: EHLO exchange.example.com Hello [192.168.10.34], SIZE 41943040, PIPELINING, DSN, ENHANCEDSTATUSCODES, AUTH, 8BITMIME, BINARYMIME, CHUNKING, XEXCH50
|_ HELP This server supports the following commands: HELO EHLO STARTTLS RCPT DATA RSET MAIL QUIT HELP AUTH BDAT
80/tcp   open  http          Microsoft IIS webserver 7.0
|_ html-title: 403 - Forbidden: Access is denied.
88/tcp   open  kerberos-sec  Microsoft Windows kerberos-sec
110/tcp  open  pop3          MS Exchange 2007 pop3d
|_ pop3-capabilities: USER SASL(NTLM GSSAPI PLAIN) TOP UIDL
135/tcp  open  msrpc         Microsoft Windows RPC
139/tcp  open  netbios-ssn
143/tcp  open  imap          Microsoft Exchange 2007 imapd
|_ imap-capabilities: IMAP4rev1 AUTH=GSSAPI LITERAL+ IMAP4 AUTH=NTLM AUTH=PLAIN NAMESPACE IDLE
389/tcp  open  ldap
443/tcp  open  ssl/http      Microsoft IIS webserver 7.0
|_ sslv2: server still supports SSLv2
|_ html-title: IIS7
445/tcp  open  microsoft-ds  Microsoft Windows 2003 microsoft-ds
464/tcp  open  kpasswd5?
587/tcp  open  smtp          Microsoft ESMTP
|  smtp-commands: EHLO exchange.example.com Hello [192.168.10.34], SIZE 41943040, PIPELINING, DSN, ENHANCEDSTATUSCODES, AUTH GSSAPI NTLM, 8BITMIME, BINARYMIME, CHUNKING
|_ HELP This server supports the following commands: HELO EHLO STARTTLS RCPT DATA RSET MAIL QUIT HELP AUTH BDAT
593/tcp  open  ncacn_http    Microsoft Windows RPC over HTTP 1.0
636/tcp  open  tcpwrapped
993/tcp  open  imaps?
995/tcp  open  pop3s?
1025/tcp open  msrpc         Microsoft Windows RPC
1026/tcp open  msrpc         Microsoft Windows RPC
1027/tcp open  msrpc         Microsoft Windows RPC
1029/tcp open  msrpc         Microsoft Windows RPC
1030/tcp open  ncacn_http    Microsoft Windows RPC over HTTP 1.0
1031/tcp open  msrpc         Microsoft Windows RPC
1048/tcp open  msrpc         Microsoft Windows RPC
3268/tcp open  ldap
3269/tcp open  tcpwrapped
3389/tcp open  microsoft-rdp Microsoft Terminal Service
6001/tcp open  ncacn_http    Microsoft Windows RPC over HTTP 1.0
6002/tcp open  ncacn_http    Microsoft Windows RPC over HTTP 1.0
6004/tcp open  ncacn_http    Microsoft Windows RPC over HTTP 1.0
2 services unrecognized despite returning data. If you know the service/version, please submit the following fingerprints at http://www.insecure.org/cgi-bin/servicefp-submit.cgi :
==============NEXT SERVICE FINGERPRINT (SUBMIT INDIVIDUALLY)==============
SF-Port993-TCP:V=5.00%I=7%D=12/15%Time=4B2803DB%P=x86_64-unknown-linux-gnu
SF:%r(NULL,20,"\*\x20BYE\x20Connection\x20is\x20closed\.\x2014\r\n");
==============NEXT SERVICE FINGERPRINT (SUBMIT INDIVIDUALLY)==============
SF-Port995-TCP:V=5.00%I=7%D=12/15%Time=4B2803DB%P=x86_64-unknown-linux-gnu
SF:%r(NULL,1F,"-ERR\x20Connection\x20is\x20closed\.\x2013\r\n");
Service Info: Host: exchange.example.com; OS: Windows
Host script results:
|_ nbstat: NetBIOS name: SERVER, NetBIOS user: , NetBIOS MAC: 00:22:19:54:ea:4d
|  smb-os-discovery: Windows Server (R) 2008 Standard 6001 Service Pack 1
|  LAN Manager: Windows Server (R) 2008 Standard 6.0
|  Name: example\SERVER
|_ System time: 2009-12-15 15:42:39 UTC-6

And Next time, don’t call me Shirley!

Now I am sure Linux is immune to this though!

Now I don’t want to brag, but all the linux servers first responded with

Starting Nmap 5.00 ( http://nmap.org ) at 2009-12-15 15:53 CST
All 1000 scanned ports on 192.168.10.20 are filtered
Service detection performed. Please report any incorrect results at http://nmap.org/submit/ .
Nmap done: 1 IP address (1 host up) scanned in 32.04 seconds

This was from default Ubuntu installs, eventually I did a scan on our webserver

Starting Nmap 5.00 ( http://nmap.org ) at 2009-12-15 15:54 CST
Interesting ports on mail.sipmeeting.com (example.com):
Not shown: 988 closed ports
PORT     STATE SERVICE   VERSION
21/tcp   open  ftp       ProFTPD 1.3.0a
22/tcp   open  ssh       OpenSSH 4.6 (protocol 1.99)
|_ sshv1: Server supports SSHv1
|  ssh-hostkey: 2048 da:5e:f2:1e:63:47:14:29:bd:f9:e3:ca:aa:4e:2b:20 (RSA1)
|  1024 4a:6d:a3:75:d9:8d:c8:dc:32:82:6d:81:d8:39:81:d4 (DSA)
|_ 2048 92:90:42:06:61:70:f8:a0:38:f6:2c:54:27:b2:2b:a8 (RSA)
25/tcp   open  smtp      Sendmail 8.14.1/8.14.1
|  smtp-commands: EHLO mail.example.com Hello [1.1.1.1], pleased to meet you, ENHANCEDSTATUSCODES, PIPELINING, 8BITMIME, SIZE, DSN, ETRN, AUTH DIGEST-MD5 CRAM-MD5, DELIVERBY, HELP
|_ HELP 2.0.0 This is sendmail version 8.14.1 2.0.0 Topics: 2.0.0 HELO EHLO MAIL RCPT DATA 2.0.0 RSET NOOP QUIT HELP VRFY 2.0.0 EXPN VERB ETRN DSN AUTH 2.0.0 STARTTLS 2.0.0 For more info use "HELP ". 2.0.0 To report bugs in the implementation see 2.0.0 http://www.sendmail.org/email-addresses.html 2.0.0 For local information send email to Postmaster at your site. 2.0.0 End of HELP info
37/tcp   open  time      (32 bits)
80/tcp   open  http      Apache httpd 2.2.4 ((Unix) DAV/2 PHP/5.2.4)
|  html-title: Online Global Resource
|_ Requested resource was http://example.com/src/login.php
110/tcp  open  pop3      Openwall popa3d
|_ pop3-capabilities: capa
111/tcp  open  rpcbind
|  rpcinfo:
|  100000  2        111/udp  rpcbind
|  100011  1,2      929/udp  rquotad
|  100003  2,3,4   2049/udp  nfs
|  100024  1      55627/udp  status
|  100021  1,3,4  55629/udp  nlockmgr
|  100005  1,2,3  55630/udp  mountd
|  100000  2        111/tcp  rpcbind
|  100011  1,2      932/tcp  rquotad
|  100003  2,3,4   2049/tcp  nfs
|  100024  1      50902/tcp  status
|  100021  1,3,4  51522/tcp  nlockmgr
|_ 100005  1,2,3  60993/tcp  mountd
143/tcp  open  imap      UW imapd 2004.357
|_ imap-capabilities: BINARY THREAD=ORDEREDSUBJECT IMAP4REV1 STARTTLS LOGIN-REFERRALS UNSELECT SCAN SASL-IR THREAD=REFERENCES MAILBOX-REFERRALS SORT AUTH=LOGIN LITERAL+ IDLE NAMESPACE MULTIAPPEND
587/tcp  open  smtp      Sendmail 8.14.1/8.14.1
|  smtp-commands: EHLO mail.example.com Hello [1.1.1.1], pleased to meet you, ENHANCEDSTATUSCODES, PIPELINING, 8BITMIME, SIZE, DSN, AUTH DIGEST-MD5 CRAM-MD5, DELIVERBY, HELP
|_ HELP 2.0.0 This is sendmail version 8.14.1 2.0.0 Topics: 2.0.0 HELO EHLO MAIL RCPT DATA 2.0.0 RSET NOOP QUIT HELP VRFY 2.0.0 EXPN VERB ETRN DSN AUTH 2.0.0 STARTTLS 2.0.0 For more info use "HELP ". 2.0.0 To report bugs in the implementation see 2.0.0 http://www.sendmail.org/email-addresses.html 2.0.0 For local information send email to Postmaster at your site. 2.0.0 End of HELP info
2000/tcp open  callbook?
2049/tcp open  rpcbind
3306/tcp open  mysql     MySQL 5.0.37
|  mysql-info: Protocol: 10
|  Version: 5.0.37
|  Thread ID: 2757516
|  Some Capabilities: Connect with DB, Compress, Transactions, Secure Connection
|  Status: Autocommit
|_ Salt: qD@R\V{,c2kG_+SA/b#%
Service Info: Host: mail.example.com; OS: Unix
Service detection performed. Please report any incorrect results at http://nmap.org/submit/ .
Nmap done: 1 IP address (1 host up) scanned in 31.31 seconds

It was only able to detect Unix not Slackware Linux. Have fun and don’t do anything I wouldn’t do!

URL Shortening, for the Faint of Heart

John Hass — Thu, 24 Dec 2009 14:30:53 +0000

Hello, Hello, Hello. Quick tut on bit.ly in PHP, nothing more nothing less (and yes I said PHP not Perl like I am so fond of). In order to use this code you need a bit.ly account. Visit http://bit.ly/account/register?rd=/ to get a login and a API Key.

Here is the function:


function shortenURL($url) {
$login = "yourlogin";
$apikey = "your api key";
 
$newurl = file_get_contents("http://api.bit.ly/shorten?version=2.0.1&longUrl=".$url."&login=".$login."&apiKey=".$apikey);
$content = json_decode($newurl,true);
$error = $content["errorCode"];
if ($error == 0){
$newurl = $content["results"][$url]["shortUrl"];
}else {
$newurl = 0;
}
 
return $newurl;
}
?>

Just include this file in any script and call

and boom it’s shortened.

Merry Christmas you filthy animal.

Test Your Network With Ping

John Hass — Wed, 23 Dec 2009 14:30:05 +0000

Ping is a great utility to use to test if a server is up or if a server is responding in the correct time, but what if you could use ping to actually test your network infrastructure. Lets call it a “poor mans test”.

Linux ping allows you to specify the number of bytes that are sent to the server your pinging.

ping -s  127.0.0.1

The maximum packet size it 65507, this is 63.9990234 kilobytes, not a very big packet at all, but what if you sent hundreds of them a second?

Enter ping flood.

ping -s 65507 -f 127.0.0.1

To quote the ping man page:

Flood ping. For every ECHO_REQUEST sent a period “.” is printed, while for ever ECHO_REPLY received a backspace is printed. This provides a rapid display of how many packets are being dropped. If interval is not given, it sets interval to zero and outputs packets as fast as they come back or one hundred times per second, whichever is more. Only the super-user may use this option with zero interval.

Here is an example of the output

ping 192.168.10.27 -s 65507 -f
PING 192.168.10.27 (192.168.10.27) 65507(65535) bytes of data.
.
--- 192.168.10.27 ping statistics ---
267 packets transmitted, 266 received, 0% packet loss, time 4321ms
rtt min/avg/max/mdev = 11.476/14.489/30.344/5.301 ms, pipe 3, ipg/ewma 16.245/11.551 ms

If I had lost a packet it should show a packet loss. As you can see, the server is sitting on the same switch as my desktop. It dropped 0 packets and had a rtt of 11.476 ms.

Not bad!

SSH Key Sharing

John Hass — Tue, 22 Dec 2009 14:30:27 +0000

SSH allows you to do key sharing which allows you to log into a machine without typing your password, or even for that matter, having a password at all. Best of all, it does the key sharing completely encrypted, so the chance of you losing your keys in the process is very unlikely.

In my example I have 2 machines. A desktop and server. I want to be able to connect to server without entering my password.

On Desktop (there is no need to be root)

ssh-keygen -b 2048 -t rsa

A message will prompt you for the location: leave it the default.
The next menu will ask you for a pass phrase: leave it blank.
Leave the next pass phrase blank as well.

Your keys will now be generated in ~/.ssh
you can “cd ~/.ssh”
type “cat id_rsa.pub”
You will now see your public key this is the key you share with everyone. The other is your private you share this with no one.

The next step is to get your key over to server

scp id_rsa.pub username@server:~/username_id_rsa.pub

Then you must put the info in ~/.ssh/authorized_keys2

ssh username@server "cat ~/username_id_rsa.pub >> ~/.ssh/authorized_keys2"

You will now be able to ssh to server without entering your password.

Using SSH To Get Around Those Pesky Firewalls

John Hass — Mon, 21 Dec 2009 14:30:34 +0000

Firewalls are important for safety on the internet, but sometimes they just get in the way, so why not remedy that by using what you can to your advantage. At my home I am required to have an SSH connection back to the office. The office is able to connect to all of our remote sites, but I am not able to have VNC to my home, so I must tunnel VNC. In order to do that I do a SSH local port forward

ssh john@example.com -L8080:127.0.0.1:5590

This will connect to my desktop at work and create a tunnel. The tunnel is from the machine I am sshing from to my desktop at work on port 5590. So to connect to VNC I just do:

vncviewer 127.0.0.1:8080

Then I am connected via the ssh tunnel to work.

Now lets say you wanted to connect off site to somewhere else, but your always having to ssh to work then to the site so:

Laptop ====> work (example.com)====> site (site.com)

and you have to ssh in 3 times to run different processes or view logs. Why not create a tunnel to do all the work?

ssh john@example.com -L8080:site.com:22

You can then ssh right into site.com by typing

ssh john@localhost -P 8080

this is because the connection is tunneled.

I will get into more ssh stuff as needed like remote port sharing and sharing keys, but the above example really does show the power of ssh.

Speeding Up MySQL with Indexes

John Hass — Fri, 18 Dec 2009 14:30:05 +0000

MySQL is an excellent database product and even though Oracle just bought out Sun, who bought out MySQL, Oracle still promised to keep up with MySQL patches and releases. (see more here) This is great news for all us die hard MySQL and PHP guys, we no longer have to worry about giving up our MySQL for something else (because you can have my PHP when you pry it from my cold dead fingers). Though the question of the day is, when we get Millions of records how can we speed it up. Say for example I have a callrecord database that has a few things in it

id|start_time|from_number|to_number|billsec

When I do a query by id everything is fast, but when I do a query by from_number everything is really slow, maybe even taking hours to complete. So lets create an index on the from_number to make it faster.

CREATE INDEX full_from_number ON table_name (from_number);

Now depending on the number of records you have this could take sometime. You can check on the status by opening another MySQL session and typing “show processlist”. This will show you what is currently going on in MySQL. It may appear that your MySQL has froze, but it hasn’t. Be patient, I had a database take 18 hours before.

Why not index all fields? This is a good question, but it is important to only index the fields that you perform a where on, creating an index, does slow the insert time some, but in my example with the callrecord database, I only filled it once a day and queried 100 times the next day, so creating extra indexes was a good thing to do.

Setting Your Clock From Google

John Hass — Thu, 17 Dec 2009 14:30:40 +0000

It’s time for another episode of, why the hell would you want to do that, I am your host John Hass. On Today’s show we are going to teach you how to set the time from Google’s web server.

So the first question is why, my answer is why not. The web is full of useless things, lets add one more. Once again using Linux and Perl, you must be root to set the time.

#!/usr/bin/perl
use IO::Socket;

IO::Socket is the only required library for this endeavor.

$host=shift || 'www.google.com';

Google does not have to be where you get your time, so you can call the program with your favorite web host, but I figure you go to them for everything else why not go to them for the time.

my $sock = new IO::Socket::INET (
PeerAddr =>; $host,
PeerPort =>; '80',
Proto =>; 'tcp',
);
die "Could not create connection to $host $!\n" unless $sock;

Create the socket connection to Google, we only support http so I just forced the port to 80.

print $sock "HEAD / HTTP/1.1\r\n\r\n";
$ok = 0;
$loop = 0;
$date = "";

Give Google the Head command to ask for some juicy info.

while() {
chomp($_);
#print $_ . "\n";
if ($ok == 0 &;&; $loop == 1) {
print "Could not get the time\n";
close($sock);
}
if ($ok == 1 &;&; $loop == 1) {
if ($_ =~ /Date:/) {
$date = $_;
close($sock);
}
}
if ($_ =~ /200 OK/) {
$ok=1;
$loop++;
}
}
close($sock);

Parse what your momma gave you, we are looking to make sure the request worked ok and we are making sure that we have a date.

if ($date =~ /GMT/) {
print "Date and time is in GMT\n";
print "$date\n";
$date =~ s/\r//g;
$date =~ s/Date: //g;
`date -s "$date"`;
}

lastly we parse out all the junk that we can’t pass to the Linux date command. then we simply set the date.

Thanks for wasting your time with me.

Now go give that network administrator the finger for not letting you specify your own ntp servers!

Source Files: gettime.zip (14)

Sweet Google TTS

John Hass — Wed, 16 Dec 2009 15:00:27 +0000

Google now has a text to speech service that allows you to type in a URL and some text and it will give you an mp3! It works fairly well, so I decided to use my Swiss Army knife (Perl) and write a script that will make it easy to get mp3′s

#!/usr/bin/perl
use LWP;
 
$speak = $ARGV[0];
 
if (length($speak) ==0 || length($speak) > 100) {
print "what you speak needs to be > 0 and <100\n";
exit;
}

This code will check to make sure that what we want to say follows with google standards. The program is called ./speak.pl “this is what I want to say”

my @headers1 = (
'Host' => 'translate.google.com',
'User-Agent' => 'Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9.1.5) Gecko/20091109 Ubuntu/9.10 (karmic) Firefox/3.5.5',
'Accept' => 'text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8',
'Accept-Language' => 'en-us,en;q=0.5',
'Accept-Encoding' => 'gzip,deflate',
'Accept-Charset' => 'ISO-8859-1,utf-8;q=0.7,*;q=0.7',
'Keep-Alive' => '300',
'Connection' => 'keep-alive',
);
 
$browser = LWP::UserAgent->new;

The above is our magic headers. This allows us to use Google and the browser instantiation.

next we need to format it so Google can see it correctly

$speak =~ s/ /+/g;

This removes all spaces and makes them +’s

lastly we connect and download

$sec = time();
$resp = $browser->get("http://translate.google.com/translate_tts?q=$speak",@headers1);
 
open(FILE,">$sec.mp3");
print FILE $resp->content;
close(FILE);
print "Wrote $sec.mp3\n";

What we do here get the number of seconds for the out filename and write the file.

Have fun and don’t abuse this service.

Source Files: tts.zip (156)