Squid Server Configuration: Part-2

<div dir="ltr" style="text-align: left;" trbidi="on"> <br /> <div class="separator" style="clear: both; text-align: center;"> <a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjPr76rRefYQYNy3H3YV-RJBoH3S5zlD_tzYJD7Fol_NCJ9_TXYaZGAXFPle80xeHourAdT4VuTtutKfdV4k5SesTw0dU91sAdGLIi-zGprhG9BZcX2D0xH6V1rcfyvrjYfZfBHlI9e9sfj/s1600/Squid-Server-conifg-part-2-700x454.jpg" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjPr76rRefYQYNy3H3YV-RJBoH3S5zlD_tzYJD7Fol_NCJ9_TXYaZGAXFPle80xeHourAdT4VuTtutKfdV4k5SesTw0dU91sAdGLIi-zGprhG9BZcX2D0xH6V1rcfyvrjYfZfBHlI9e9sfj/s1600/Squid-Server-conifg-part-2-700x454.jpg" /></a></div> <h2 style="text-align: left;"> <br /></h2> <div class="wpb_row row-fluid"> <h2 style="text-align: left;"> </h2> <div class="span12 wpb_column column_container"> <div class="wpb_wrapper"> <div class="td_block_wrap td_text_with_title"> <h2 class="block-title" style="text-align: left;"> <b><span style="font-weight: normal;">How to block flash videos using Squid ? : rep_mime_type</span></b></h2> <h2 class="block-title" style="text-align: left;"> <b><span style="font-weight: normal;"> </span></b></h2> <div class="td_mod_wrap"> To block certain content types. Squid currently can not do “content inspection” to decide on the file type based on the contents, but it is able to block HTTP replies based on MIME  ( file extension type) Block flash video<br /> The MIME type for such content is “video/x-flv”.   Edit /etc/squid/squid.conf<br /> Create an ACL<br /> <strong>acl  block-flashvideos  rep_mime_type  video/x-flv</strong><br /> Set Action<br /> <strong>http_reply_access  deny  block-flashvideos</strong><br /> It will block flash videos</div> </div> </div> </div> </div> <div class="wpb_row row-fluid"> <div class="span12 wpb_column column_container"> <div class="wpb_wrapper"> <div class="td_block_wrap td_text_with_title"> <h2 class="block-title" style="text-align: left;"> <span> </span></h2> <h2 class="block-title" style="text-align: left;"> <span>How to Block Internet Explorer Browser With Squid ?</span></h2> <div class="td_mod_wrap"> acl syntax :<br /> acl <strong><acl name></strong> browser  <strong><UserAgent></strong> Edit squid.conf for<br /> <br /> <strong>acl block_browser browser MSIE</strong><br /> <strong>http_access deny block_browser</strong><br /> is also possible to block specific version or other browsers too:<br /> <strong>acl block_bad_browser browser MSIE.9</strong><br /> <strong>acl block_bad_browser browser MSIE.10</strong><br /> <strong>acl block_bad_browser browser Firefox</strong><br /> <strong>acl block_bad_browser browser Chrome/38</strong><br /> <strong>http_access deny block_bad_browser</strong></div> </div> </div> </div> </div> <div class="wpb_row row-fluid"> <div class="span12 wpb_column column_container"> <div class="wpb_wrapper"> <div class="td_block_wrap td_text_with_title"> <h2 class="block-title" style="text-align: left;"> <span> </span></h2> <h2 class="block-title" style="text-align: left;"> <span>How to configure squid to use multiple outgoing IP addresses ?</span></h2> <div class="td_mod_wrap"> We have a  Linux PC with multiple IP Address  and  Squid Proxy Server  configured, Our  browser to use that proxy on one of these IP and go out from that server with the same IP and not with the default ip .<br /> This is very useful if you have services that require 1 specific IP to be allowed, or if you want to give the proxy server to different people and still be able to trace what they do. To implement this follow the steps<br /> <br /> Use multiple IP addresses based on the squid’s IP being used as proxy server<br /> <strong> </strong><br /> <strong>acl  IPADDRESS-1  myip  192.168.0.20</strong><br /> <strong>acl  IPADDRESS-1   myip  192.168.0.21</strong><br /> <strong>acl  IPADDRESS-1   myip  192.168.0.23</strong><br /> <strong>tcp_outgoing_address 192.168.0.20  IPADDRESS-1  </strong><br /> <strong>tcp_outgoing_address 192.168.0.21  IPADDRESS-2  </strong><br /> <strong>tcp_outgoing_address 192.168.0.23  IPADDRESS-3 </strong><br /> <br /> </div> </div> </div> </div> </div> <div class="wpb_row row-fluid"> <div class="span12 wpb_column column_container"> <div class="wpb_wrapper"> <div class="td_block_wrap td_text_with_title"> <h2 class="block-title" style="text-align: left;"> <span>How to Clear Squid Proxy Cache Directory and Re-create ?</span></h2> <div class="td_mod_wrap"> We can clear cache by deleting these, and recreate , follow steps <strong># squid -k shutdown</strong><br /> or<br /> <strong># service squid stop</strong><br /> <strong># cd   /var/spool/squid</strong>  <span style="color: red;"> <—This is cache dir</span><br /> <strong># rm -rf *</strong><br /> <strong># squid -z</strong><br /> 2015/06/13 12:13:24| Creating Swap Directories<br /> Note: this will recreate cache directories again<br /> <strong># ls</strong><br /> 00 01 02 03 04 05 06 07 08 09 0A 0B 0C 0D 0E 0F<br /> <strong># service squid start</strong><br /> Note : Its better to use ‘squid -k reconfigure’ rather thant restarting squid as it wont have to stop the cache, so its almost instant.<br /> <strong>Verify Squid for up and running</strong><br /> <br /> <strong># netstat -tulpn | grep :3128</strong><br /> <strong># tail -f /var/log/squid/access.log</strong><br /> <strong># tail -f /var/log/squid/cache.log</strong></div> </div> </div> </div> </div> <div class="wpb_row row-fluid"> <div class="span12 wpb_column column_container"> <div class="wpb_wrapper"> <div class="td_block_wrap td_text_with_title"> <h3 class="block-title" style="text-align: left;"> <span>About Squid Logs </span></h3> <div class="td_mod_wrap"> <strong>/var/log/squid/</strong> is the default directory for squid logs there are three logs<br /> <strong>/var/log/squid/access.log : </strong>Surfing details, we can view who is doing what in this log.<br /> <strong> /var/log/squid/cache.log :</strong> The cache.log file contains the debug and error messages that squid generates<br /> <strong> /var/log/squid/store.log :</strong> The store.log file covers the objects currently kept on disk or removed ones.<br /> <h3 style="text-align: left;">  </h3> <h3 style="text-align: left;"> </h3> <h3 style="text-align: left;"> <strong>Disable logging in Squid Proxy</strong></h3> If we have any requirements of disabling logs of squid proxy service. Follow these simple steps to disable all kind of logging by squid service.<br /> To disable access log, edit <strong>/etc/squid/squid.conf</strong><br /> ​access_log none<br /> To disable store log, edit <strong>/etc/squid/squid.conf</strong><br /> cache_store none<br /> To disable cache log, edit /<strong>etc/squid/squid.conf</strong><br /> cache_log /dev/null<br /> logfile_rotate 0</div> </div> </div> </div> </div> </div>

Squid Server Configuration: Part-2

How to block flash videos using Squid ? : rep_mime_type   To block certain content types. Squid currently can not ...

Read more »

SARG Report Generator :: Squid Log Analysis

<div dir="ltr" style="text-align: left;" trbidi="on"> <div class="separator" style="clear: both; text-align: center;"> </div> <div class="separator" style="clear: both; text-align: center;"> <a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEisjJQdLQPvuc44b7JgfD8pBMov3rKNxJZFvsG9bxIWKtN2FN5rDw-ilmaRIk5aBSLf5Whs8Naek-06ENbhS0KQ_ofkasds7ktLXFRqItgfVHWyvye651Z4Oj2_iZ0UnGmX1BPnksZSysfk/s1600/SARG-700x454%255BFeatured%255D.jpg" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEisjJQdLQPvuc44b7JgfD8pBMov3rKNxJZFvsG9bxIWKtN2FN5rDw-ilmaRIk5aBSLf5Whs8Naek-06ENbhS0KQ_ofkasds7ktLXFRqItgfVHWyvye651Z4Oj2_iZ0UnGmX1BPnksZSysfk/s1600/SARG-700x454%255BFeatured%255D.jpg" /> </a></div> <div class="separator" style="clear: both; text-align: center;"> <br /></div> <br /> SARG is a Open Source Tool, FREE and under GPL , It creates Squid Log Reports in HTML formats, looks beautiful, Variety of option given in the tool for Daily, Weekly, Monthly Report . helps us to view how much bandwidth is utilized by individual machines on the network.<br /> <br /> This article is tested on centOS 5.4<br /> <br /> <div class="separator" style="clear: both; text-align: center;"> <a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhZZQWoqwgBWkKPyxK0RnlNO-_LL_PbIVfUyKAIIrgBaZLVSgYYV_qAQfTYR1Lr6pkB8p2hp_5_y036wCEj5tFUCXvEOU0UrZugb_2tSRZ5goDpTnzEi0nIRfiyA5mkgzBryZ8VK8wDlJKT/s1600/Sarg+pic+2.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="320" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhZZQWoqwgBWkKPyxK0RnlNO-_LL_PbIVfUyKAIIrgBaZLVSgYYV_qAQfTYR1Lr6pkB8p2hp_5_y036wCEj5tFUCXvEOU0UrZugb_2tSRZ5goDpTnzEi0nIRfiyA5mkgzBryZ8VK8wDlJKT/s320/Sarg+pic+2.png" width="320" /></a></div> <h2 class="block-title" style="text-align: left;"> <span style="background-color: #eeeeee;"><span style="font-family: inherit;"><span style="font-size: large;">Step by step Installation of SARG </span></span></span></h2> <b>Step 1</b>:  Install required packages # yum install –y gcc<br /> # yum install –y gd<br /> # yum install –y gd-devel<br /> # yum install –y make<br /> # yum install –y perl-GD<br /> # yum install –y wget<br /> # yum install –y httpd<br /> <br /> <b>Step 2:</b> Download and Install SARG <br /> # wget http://garr.dl.sourceforge.net/project/sarg/sarg/sarg-2.3.7/sarg-2.3.7.tar.gz<br /> # tar -xvzf sarg-2.3.7.tar.gz<br /> # cd sarg-2.3.7<br /> # ./configure<br /> # make<br /> # make install<br /> <br /> <b>Step3:</b> Configure SARG<br /> Edit Sarg Configuration File for Access Log Path,Output Directory,Date Format, Overwrite report for same date<br /> # vi /usr/local/etc/sarg.conf<br /> Search<br /> <b>#access_log /usr/local/squid/var/logs/access.log</b><br /> Put actual log location<br /> <b>access_log /usr/local/squid/var/logs/access.log</b><br /> un comment<br /> <b>output_dir /var/www/html/squid-reports</b><br /> un comment date format, to view correct date format modify<br /> <b>#date_format u </b>     <span style="color: red;"><—–change this</span><br /> <b>date_format e</b><br /> Note : ‘<b>date_format e</b>‘ will display reports in <b>‘dd/mm/yy</b>‘ format.<br /> Un comment<br /> <b>#overwrite_report no</b><br /> <b>overwrite_report yes</b> <span style="color: red;"> <–change this means report date already exist then will be overwritten</span><br /> now save the config file, modification is over<br /> <br /> <b>Step 4:</b> Generation Sarg Report<br /> <b># sarg –x</b><br /> SARG: Init<br /> SARG: Loading configuration from /usr/local/etc/sarg.conf<br /> SARG: Parameters:<br /> SARG:           Hostname or IP address (-a) =<br /> SARG:                   Useragent log (-b) =<br /> SARG:                     Exclude file (-c) =<br /> SARG:                 Date from-until (-d) =<br /> SARG:   Email address to send reports (-e) =<br /> SARG:                     Config file (-f) =  <span style="color: red;">/usr/local/etc/sarg.conf</span><br /> SARG:                     Date format (-g) =  <span style="color: red;">Europe (dd/mm/yyyy)</span><br /> SARG:                       IP report (-i) = No<br /> SARG:             Keep temporary files (-k) = No<br /> SARG:                        Input log (-l) = <span style="color: red;">/var/log/squid/access.log</span><br /> SARG:               Resolve IP Address (-n) = No<br /> SARG:                       Output dir (-o) = <span style="color: red;">/var/www/html/squid-reports/</span><br /> SARG: Use Ip Address instead of userid (-p) = No<br /> SARG:                  Accessed site (-s) =<br /> SARG:                             Time (-t) =<br /> SARG:                             User (-u) =<br /> SARG:                   Temporary dir (-w) = /tmp/sarg<br /> SARG:                   Debug messages (-x) = Yes<br /> SARG:                 Process messages (-z) = No<br /> SARG: Previous reports to keep (–lastlog) = 0<br /> SARG:<br /> SARG: sarg version: 2.3.7 May-30-2013<br /> SARG: Reading access log file: /var/log/squid/access.log<br /> SARG: Records in file: 624, reading: 100.00%<br /> SARG:   Records read: 624, written: 624, excluded: 0<br /> SARG: Squid log format<br /> SARG: Period: 12 Jun 2015<br /> SARG: Sorting log /tmp/sarg/192_168_0_155.user_unsort<br /> SARG: Making file: /tmp/sarg/192_168_0_155<br /> SARG: Sorting file: /tmp/sarg/192_168_0_155.utmp<br /> SARG: Making report: 192.168.0.155<br /> SARG: Making index.html<br /> SARG: Successful report generated on <span style="color: red;">/var/www/html/squid-reports</span>/12Jun2015-12Jun2015<br /> SARG: Purging temporary file sarg-general<br /> SARG: End<br /> <br /> <b>Step 5:</b> Assessing SARG Report<br /> Sarg will generate reports in ‘<b>/var/www/html/squid-reports </b><b>directory</b><b>, </b>Which can be accessed from the web browser using the address.<br /> <b><a href="http://192.168.0.65/squid-reports/">http://192.168.0.65/squid-reports/</a></b><br /> <br /> <b>   Figure 1</b><br /> <div class="separator" style="clear: both; text-align: center;"> <a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjuaX8vwFj0EzB0Y4srY3j1UN7f0FdpsUBbcX4_60S9SEZ2Q3lJqxUKkencNLH3WI8yBOvW6StQYl4jaqpDGWrgCqEt87HD1qVrB81SiXbQ_Ti1B5m2jzDE5Ng4rCZO6CHQRpPhcRCskFWb/s1600/Sarg+figure+1.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjuaX8vwFj0EzB0Y4srY3j1UN7f0FdpsUBbcX4_60S9SEZ2Q3lJqxUKkencNLH3WI8yBOvW6StQYl4jaqpDGWrgCqEt87HD1qVrB81SiXbQ_Ti1B5m2jzDE5Ng4rCZO6CHQRpPhcRCskFWb/s1600/Sarg+figure+1.png" /> </a></div> <div class="separator" style="clear: both; text-align: center;"> <br /></div> <b> Figure 2 </b><br /> <br /> <div class="separator" style="clear: both; text-align: center;"> <a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjy0IRVsxb4rmRwIBdi6CtuwQbLdQSeVALm6F5dXgqB6ULxm6skJ-tF0AvhMuNHYLe7_yUJ_5ZjbhaeM-I6UdB8blOhlgPvmP8-ptRK4Qsxm4ScRGzmAljyv5gVgvHZ4lGzCikOr06yvsPK/s1600/sarg+figure+2.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjy0IRVsxb4rmRwIBdi6CtuwQbLdQSeVALm6F5dXgqB6ULxm6skJ-tF0AvhMuNHYLe7_yUJ_5ZjbhaeM-I6UdB8blOhlgPvmP8-ptRK4Qsxm4ScRGzmAljyv5gVgvHZ4lGzCikOr06yvsPK/s1600/sarg+figure+2.png" /></a></div> <b><br /></b>  <b>Figure 3</b><br /> <br /> <div class="separator" style="clear: both; text-align: center;"> <a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgoqWO0I7uwDp1E15ztMieJn8Fip0tn8zyaukjNNRFcZlJFmkeTNippBpBmL5-d-YIkMh1tewIfkvnjTQeBhnUcXM8qCp7Obv2_V4EWp3Sf_C5TJzkTQeMLJtBnq1k9WkAX7t0dHT0LEw-v/s1600/sarg+figure+3.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgoqWO0I7uwDp1E15ztMieJn8Fip0tn8zyaukjNNRFcZlJFmkeTNippBpBmL5-d-YIkMh1tewIfkvnjTQeBhnUcXM8qCp7Obv2_V4EWp3Sf_C5TJzkTQeMLJtBnq1k9WkAX7t0dHT0LEw-v/s1600/sarg+figure+3.png" /></a></div> <br /> <br /> <b>Step 6:  </b>Scheduling for Generate SARG Report<br /> <br /> <b># crontab –e </b><br /> <b>*/2   * * * * <b>/usr/local/bin/sarg –x</b></b><b> </b><b> </b><br /> <br /> Above cron will generate report evry two hours, modify as per your need<br /> That’s it  !!<br /> <br /></div>

SARG Report Generator :: Squid Log Analysis

  SARG is a Open Source Tool, FREE and under GPL , It creates Squid Log Reports in HTML formats, looks beautiful, Variety of option...

Read more »